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Abstract: The European workplace is challenging VET adults’ problem-solving 
skills in technology-rich environments (TREs). So far, no international large-scale 
assessment data has been available for VET. The PIAAC data comprise the most 
comprehensive source of information on adults’ skills to date. The present study 
(N=50 369) focuses on gaining insight into the problem-solving skills in TREs of 
adults with a VET background. When examining the similarities and differences in 
VET adults’ problem-solving skills in TREs across 1 1 European countries, two 
main trends can be observed. First, our results show that only a minority of VET 
adults perform at a high level. Second, there seems to be substantial variation 
between countries with respect to the proportion of VET adults that can be 
identified as “at-risk” or “weak” performers. For the future, our findings indicate 
the variations that can be used as a starting point to identify beneficial VET 
approaches. 
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1 Introduction 

The European workplace is going through a radical process of structural change, 
from mass-production technology to more flexible production methods. For adults 
with vocational education and training (VET), this structural change often means 
changes in their job descriptions (as routine tasks are taken over by technologies, 
Goos, 2013). As a direct result, many of today’s workplaces require creative 
problem-solving instead of in-routine activities in a variety of technology-rich 
settings. Therefore, the ability to work and solve problems in technology-rich 
environments (TREs) plays an increasingly important role (Frey and Osborne, 
2013; Goos, 2013). Related to this change, adults’ problem-solving skills (or the 
lack thereof) may have short-term influence on how well workers are able to 
manage their work tasks and long-term influence on European welfare and 
competitiveness. As a direct result of this advancement, problem-solving in 
Europe’s TRE is one of the most important skills for future working life (Goos, 
2013). In line with these emerging requirements, it is generally agreed that there is 
a need to develop adults’ skills and abilities to better meet the changing needs of 
the European workplace in terms of problem-solving in TRE, for example through 
formal education (Billett, 2008; Teichler, 2007; Fuller and Unwin, 2004) and 
lifelong (Loveder, 2011) and workplace learning (Billett, 2008; Tynjala, 2013). 

Currently, there is an emerging need for a greater understanding of the 
relationship between VET adults’ problem-solving skills in a TRE and their 
educational needs in these same realms at the European level. According to Lawn 
(2013), at best, it may be possible to benefit from the knowledge gathered from 
large-scale assessments in providing indicators of the skills of the adult population. 
The aim is that, when adults’ skills are analysed together with educational systems, 
educational approaches are better able to meet emerging societal needs. Recently, 
results of the Programme for the International Assessment of Adult Competencies 
(P1AAC) - the most comprehensive study of adult skills ever undertaken, led by 
the Organisation for Economic Co-operation and Development (OECD) - showed 
that problem-solving skills in TREs vary among the European countries (OECD, 
2013a). In general, Nordic countries, such as Finland, had overall high proficiency 
levels in problem solving in TREs. However, a recent analysis of the P1AAC data 
(Hamalainen, De Wever, Malin and Cincinnato, 2014) highlighted the critical issue 
that, despite Finns’ high proficiency in general for problem-solving in TREs, the 
majority of adults with VET have weak skills or lack skills needed to solve 
problems in TREs. As a direct result, a crucial question for VET development 
involves investigating if the same trend holds true in other parts of Europe. Thus, 
we need to investigate what the level and distribution of problem-solving skills in 
TREs for adults with VET is in Europe and how well adults’ vocational skills and 
professional expertise match the changing needs of European society. 

As a starting point for investigating VET adults’ skills and abilities, we have 
to consider that, in general, VET education approaches vary between European 
countries (for a detailed description, see Eurydice Highlights 2012/2013; OECD, 
2009), and this may have an influence on adults’ problem-solving skills in TREs. 
Specifically, VET has traditionally been based on either school- or work-based 
approaches (European Commission, 2013). In work-based approaches (applied, 
following the Eurydice Highlights 2012/2013, for example, in Germany, Austria 
and Switzerland) learning is intertwined with authentic work contexts, and learners 
spend a minimal amount of their time in a school setting. Alternatively, in school- 
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based approaches (such as in France and Scandinavian countries, including 
Norway and Finland), learning more often takes place in traditional school settings. 
Flowever, despite the differences in the approach of where vocational learning 
takes place, both approaches face the same challenge of structural changes in 
Europe’s workplace. For these reasons, critical discussions are currently underway 
about whether the new needs of the structural change (e.g. skills and abilities of 
creative problem-solving in TREs) have reached our VET adults in a satisfactory 
way. Furthermore, it is important to find out how different European VET 
education approaches are associated with VET adults’ problem-solving skills in 
TREs. 

2 Aims 

Europe’s workplace calls for a new understanding of VET adults’ problem-solving 
skills in TREs. So far, no international large-scale assessment data has been 
available for VET (cf. Programme for International Student Assessment (PISA) for 
15-year student assessment and Assessment of Higher Education Learning 
Outcomes (AHELO) for higher education student assessment). Therefore, P1AAC 
data enables us to get new insight into the VET. Namely, this study aims to 
investigate VET adults’ performance in problem-solving in TREs and its relation to 
educational approaches. Specifically, our aim was to identify: 

• What is the level and distribution of problem-solving skills in TREs for adults 
with VET in Europe? 

• How is the level and distribution of problem-solving skills in TREs for adults 
with VET related to adults with other educational backgrounds? 

3 Method 

In practice, P1AAC data and Eurostat classification of the VET approaches were 
used for this study. Firstly, we used the OECD P1AAC data to obtain knowledge 
on the VET adults’ performance on problem-solving in TREs. The objective of the 
P1AAC was to determine whether adults’ basic skills were at a level that made 
them ready to respond to the unpredictable needs of the future, which might 
involve rapid changes. Secondly, calculations of the European Centre for the 
Development of Vocational Training (Cedefop) based on Eurostat classification for 
upper secondary VET on work-based approaches (for detailed description see 
European Commission, 2013, p. 7) grounded our analysis. 

3.1 Data and analysis 

The P1AAC survey was conducted by an international consortium consisting of 
several research institutions and led by the Educational Testing Service (ETS, 
USA). Under the guidance of the consortium, each participating country 
implemented the survey (for a detailed description, see OECD, 2013b, chapters 
10-13). The P1AAC survey contained, firstly, the background questionnaire 
including questions about skills used, and secondly, computer-based test results 
that captured the level of adults’ problem-solving skills (OECD, 2013b). A total of 
66,322 16- to 65 year olds were involved (average weighted response rate of 60%, 
sample size of 113,744) in eleven European countries; 50,369 adults (males: 
n=24,812, females: n=25,556) took part in the test of problem-solving skills in 
TREs. 
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In PIAAC, proficiency is regarded as a continuum of abilities involving the 
mastery of information-processing tasks of increasing complexity. The PIAAC test 
design was based on a variant of matrix sampling, which used different sets of 
items as well as multistage adaptive testing. In addition, it used a variety of 
assessment modes where each of the respondents completed a subset of items from 
the total item pool. Since calculating a one -point estimate of proficiency for each 
respondent might lead to severely biased estimates of population characteristics, 
PIAAC uses ten plausible values that are drawn from an a posteriori distribution. 
This is done by combining the item response theory (IRT) scaling of the cognitive 
items with a latent regression model using information from the background 
questionnaire. The PIAAC Technical Report (OECD, 2013b, chapter 17) provides 
further details of the scaling of cognitive data. 

The results of problem-solving are represented on a 500-point scale, which 
was divided into four different proficiency levels. These levels are based on the 
skills and knowledge required to accomplish the tasks within each level. Level 1 
(“weak performers”) included scores from 241 to 290. Level 2 (“moderate 
performers”) included scores from 291 to 340 and Level 3 (“strong performers”) 
included scores equal to or higher than 341. Additionally, the participants who 
scored below Level 1 were defined as “at risk”. Moreover, there is a “not- 
classified” group included in the sample. The reasons for this group not being 
classified are rather diverse (i.e. failed the ICT core test, no computer experience or 
opted out of the computer-based assessment, or fell out due to literacy-related non- 
response). As such, it is difficult to make proper statements about this group. Given 
the fact that there is no information at all with respect to their problem-solving 
proficiency level present in the database, we opted not to include them in our 
analyses, except for our first analyses presenting a general overview. 

The statistical analyses were implemented by taking the survey design into 
account using weights. The mean of regressions over ten plausible values was 
calculated, using Jack-knife replication for variance estimation (for further details, 
see OECD, 2013b, chapters 14-15). 

3.2 Detecting the level of the problem-solving skills in TREs 

The aim of evaluating problem-solving in TREs was to assess how adults use 
technology in order to carry out a variety of complicated problem-solving tasks. 
The assessment framework as well as the tasks and the background questionnaire 
were designed by the international expert groups (OECD, 2012). In the PIAAC 
study, problem-solving in TREs is described below: 

"Problem solving in technology-rich environments involves using digital 
technology, communication tools and networks to acquire and evaluate 
information, communicate with others and perform practical tasks. The first 
PIAAC problem solving survey will focus on the abilities to solve problems for 
personal, work and civic purposes by setting up appropriate goals and plans, 
accessing and making use of information through computers and computer 
networks". (OECD, 2012, p. 47) 

In practice, during the test each participant solved tasks using various sources 
of information on a laptop computer. The computer environment offered several 
tools participants could use, such as an Internet browser and web pages, a 
computer-based reservation system, e-mail and word processing. To summarise, 
the main goal of the assessment was to explain to which extent adults use 
technology to solve today’s problems both proficiently and efficiently (OECD, 
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2012). In this study, the first step of the analysis was to calculate the level and 
distribution of participants’ problem-solving skills. 

3.3 Investigating the differences in problem-solving skills between VET and 

other adults 

As the first phase of the investigation of problem-solving skills differences, VET 
and other adults were categorized based on their problem-solving scores. In the 
second phase, the similarities and differences with respect to the relation between 
participants’ scores of the problem-solving test and educational background were 
discovered. Finally, a variety of adults with different educational backgrounds 
were compared. In our analysis, we used multinomial logit regression to estimate 
the likelihood of attaining an at-risk or weak proficiency level compared to a 
moderate or strong proficiency level (which are combined to act as the reference 
category). Additionally, in comparing the educational categories, adults with 
vocational education serve as the reference category, in order to compare VET 
adults with graduates from (at most) lower secondary education and graduates from 
(at least) upper secondary education. 

3.4 Examining the differences between the European countries applying 

school- or work-based approaches in VET 

To examine the differences between European countries we grounded our analysis 
on the orientation that European countries have taken in VET. Thus, we based our 
analysis on the Cedefop calculations of Eurostat data (see Table 1). In practice, we 
used the share of work-based practise as a starting point for dividing European 
countries that apply school- or work-based approaches in their educational systems. 
In this phase, we included all the countries listed on the Cedefop calculation (9 
countries with low and 8 countries with high share of work-based learning; 
additionally for the rest of the European countries, no reliable data were available; 
for detailed information, see European Commission 2013; Eurydice Highlights 
2012/2013; OECD, 2009). Next, we investigated all the countries in the Cedefop 
calculations that participate in the P1AAC study (13 countries) and selected those 
countries that had data on problem-solving in TREs (Spain and France were left 
out, as they did not participate in the problem-solving test of the P1AAC). 
Additionally, as the problem-solving proficiency scores are not available for the 
participants in the “not-classified” group, they were not included in statistical 
analyses. In practice, we included 6 countries with a low and 5 countries with a 
high share of work-based learning on our analyses (Table 1). Finally, to gain 
deeper insight into the problem-solving skills in TREs of European adults with a 
VET background, similarities and differences in VET adults’ problem-solving 
skills across the European countries applying school- or work-based approaches in 
their education were investigated. 


Table 1: Share of work-based learning in 11 countries 


Share of work-based learning 

High 

Low 

Austria, Slovak Republic, Czech 
Republic, Denmark, Germany 

Belgium, Finland, Ireland, Netherland, 
Norway, Poland 
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4 Results 

4.1 The general overview of problem-solving skills in TREs in Europe 

In the following section we further shed light on the similarities and differences in 
VET adults’ problem-solving skills across the European countries applying school- 
or work-based approaches. Before that, we will firstly give an overview over VET 
adults’ problem-solving skills, including the not-classified group, to give a general 
picture of the share of this group. 

Figure 1 illustrates that among VET adults, there is a tendency to have a lack 
of or low problem-solving skills in all 1 1 countries. Specifically, only a small 
minority of VET adults score on the highest level (level 3) and 63% or more of the 
adults with VET are below the moderate performance level (level 2). Additionally, 
in all of the countries more than 1 1% of the VET adults are at-risk performers in 
problem-solving. On average, one third of adults with VET are at Level 1. The 
pattern of distribution of adults at Level 1 is largely similar and close to the school- 
and work-based average in Austria, Czech Republic, Denmark and Finland. 

Furthermore, a large share of VET adults belongs to the not-classified group, 
on average almost one third of VET adults both in the school- and work-based 
countries. The lowest share is in the Netherlands (8%). Denmark and Norway 
(16%) as well as Germany (21%) are clearly below average. An interesting 
similarity between school- or work-based approaches can be noted: in both 
approaches there is one country with a high share of the VET adults belonging to 
the not-classified group (Slovak Republic and Poland, see Figure 1). These two 
countries clearly differ from the other countries in terms of having a large not- 
classified group, and because of that, fewer VET adults score the two highest levels 
of problem-solving skills (Figure 1). 
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Note. Due to rounding, the percentages do not always add up to exactly 100 percent. 


Figure 1: Percentage of VET adults scoring at each level of problem-solving 
skills by country 

4.2 The main differences between VET and other adults’ problem-solving 
skills in TREs 

In all 1 1 countries, adults with VET perform lower on average than adults with 
other educational backgrounds. The average difference between work-based and 
school-based VET is very small (only 4 points, see Figure A1 in appendix). The 
difference between VET and non-VET adults’ problem solving skills varies 
between countries, ranging from 8 points in Austria to 32 points in Belgium (see 
Figure A1 in appendix). Thus, there is no indication of an association between 
VET adults’ problem-solving skills in TREs and education approaches applied in 
Europe. Instead, there is great variation in VET adults’ average problem-solving 
skills in TREs across 11 European countries, irrespective of whether they are 
applying school- or work-based approaches. The lowest mean performance scores 
are found in Poland and Belgium (255 points) and the highest in Austria and the 
Netherlands (280 points). 

When comparing VET adults to adults with at least upper secondary 
education, the latter strongly outperform the vocationally trained adults in all 1 1 
countries (Figure 2). On average, graduates from upper secondary or higher score 
26 points higher than VET graduates in work-based countries and 28 point higher 
in school-based countries. As the figures indicate, the difference between work- 
based and school-based countries is very small — although statistically significant 
(p < 0.05). However, there is variation between countries for both approaches. The 
difference is greatest in Belgium (42 points) and smallest in Ireland (17 points). 
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Both of these countries apply the school-based approach. In the countries applying 
the work-based approach, the difference is greatest in Denmark (31 points) and 
smallest in Austria (18 points). 

When comparing the VET group with adults with lower secondary education, 
adults with lower secondary education score higher in 7 out of 1 1 countries (Figure 
2). In this instance, the difference between work- and school-based countries is 
more pronounced: while in work-based countries, adults with VET have a 4-point- 
lower average performance score compared to adults with lower secondary 
education (p < 0.001), in the school-based countries there is no (statistically 
significant) difference in this respect (p = 0.554). The within-country variation is 
larger in school-based countries. The largest difference in favor of adults with 
lower secondary education is in Poland (25 points) and that in favor of VET adults 
is in Ireland (18 points). Among the work-based countries, the greatest difference 
in favor of adults with lower secondary education is in the Slovak Republic (17 
points) and that in favor of VET adults is in Austria (12 points). 


■ Lower secondary or less «VET ■ Higher secondary or more 


310 



Note. Due to rounding, the percentages do not always add up to exactly 100 percent. An extended 
tabulation can be found in the appendix (Table Al). 


Figure 2: Mean problem-solving scores by educational background for all 
countries 

In Figures 3 and 4, we present the proportion of adults scoring at different 
proficiency levels of problem-solving in work- and school-based countries, 
excluding the not-classified group. When comparing VET adults to graduates from 
higher secondary school or higher, we observe that there is a clear difference in 
proportion among those scoring on lower (i.e. “at risk”, and “weak”) and higher 
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levels (i.e. “moderate”, and “strong”). In fact, in work-based countries, more than 
two thirds (68%) of the VET adults perform on the lower levels compared to 42 % 
of the graduates of higher secondary school. In the school-based countries, 71% of 
the VET adults perform on the lower levels compared to 43% of the graduates of 
higher secondary. However, the differences between countries are rather large, 
even when controlling for the VET-system approach. In work-based countries, we 
can observe that the proportion of low-performing VET adults varies between 60% 
(Austria) and 78% (the Slovak Republic), whereas the proportion of low- 
performing graduates from upper secondary varies between 36% (the Czech 
Republic) and 55% (the Slovak Republic). In school-based countries, Belgium 
(Flanders) has the highest proportion of VET-qualified low performers (82%) and 
the Netherlands the lowest (60%); the proportion of low-performing higher 
secondary graduates varies between 34% (the Netherlands) and 54% (Ireland). 

Compared to lower secondary graduates (or less), VET adults show a slight 
tendency to have more adults performing on the low levels than the former. In 
work-based countries, we can observe that 61% of the lower secondary graduates 
have low levels of problem-solving skills (compared to 68% of the VET adults), 
and in school-based countries, 68% of the lower secondary graduates perform at 
low proficiency levels (compared to 71% of VET adults). However, once again 
between-country differences are rather large, even when controlling for the VET 
system; in work-based countries the proportion of low achievers among lower 
secondary graduates varies between 52% (the Czech Republic) and 69% (Austria). 
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tabulation can be found in the appendix (Table A2). 


Figure 3: Percentage of adults at each level of problem-solving skills in work- 
based countries 
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Note. Due to rounding, the percentages do not always add up to exactly 100 percent. An extended 
tabulation can be found in the appendix (Table A3). 


Figure 4: Percentage of adults at each level of problem-solving skills in school- 
based countries 


In order to examine the impact of educational background on problem-solving 
skills in work-based countries, in Table 2, we present the regression coefficients 
(and corresponding odds ratios) of the model estimating the likelihood of scoring at 
an “at risk” or “weak” problem-solving level compared to a “moderate and strong” 
proficiency level (i.e. the reference category). The figures clearly demonstrate that 
VET adults are more likely, compared to graduates from upper secondary school 
(or more), to be “at risk” or “weak” performers in problem-solving than “moderate 
or strong performers”, independently from the country of origin. More precisely, 
VET adults are 3.2 (Austria) to 7.2 (Denmark) more likely to be “at-risk” 
performers, and 2.1 (Austria) to 2.8 (Denmark) more likely to be “weak” 
performers. 

Interestingly, the between-country variation is larger when comparing the 
problem-solving skills of VET adults and graduates from lower secondary school 
(or less). In fact, with the exception of the Czech Republic, VET adults and lower 
secondary graduates are equally likely to be “weak” performers since the 
regression parameters are non-significant at a level of a = 0.05. In the Czech 
Republic, VET adults are 1.6 times more likely to be “weak” performers than 


IJRVET 2014 


VET workers’ problem-solving skills in technology-rich environments: European approach 69 


lower secondary graduates. When estimating the likelihood of being an “at-risk” 
performer, the variation between countries is even more pronounced. More in 
particular, in the Czech Republic and the Slovak Republic, VET adults are 
respectively 1.9 and 3.7 times more likely to be “at-risk” performers. In Austria, on 
the contrary, lower secondary graduates are 2.3 times more likely than VET adults 
to be “at-risk” performers. In Denmark and Germany, the likelihoods are equal. 

Table 2: Likelihood of problem-solving skills proficiency in TREs by 
educational background in work-based countries (parameter estimates with 
standard errors and odds ratios) 


At risk performers Weak performers 


b 

Odds 

Inverse 

b 

Odds 

Inverse 


ratio 

odds 


ratio 

odds 



ratio 



ratio 


Austria 

Intercept 

-1.04 

(.085) 



0.15* 

(.067) 




Low Sec vs. VET 

0.81 *** 
(.165) 

2.26 

0.44 

0.20 

(.149) 

1.22 

0.82 


Up Sec vs. VET 

-1.16 *** 
(.200) 

0.31 

3.19 

-0.74 *** 
(.115) 

0.48 

2.10 

Czech 

Republic 

Intercept 

-0.45 *** 
(.093) 



0.20 ’ 
(.084) 




Low Sec vs. VET 

-0.64 ** 
(.226) 

0.52 

1.91 

-0.48 * 
(.183) 

0.62 

1.61 


Up Sec vs. VET 

-1.86 *** 
(.219) 

0.16 

6.43 

-0.94 *** 
(.158) 

0.39 

2.57 

Denmark 

Intercept 

-0.13 

(.079) 



0.42 *** 
(.079) 




Low Sec vs. VET 

-0.21 

(.128) 

0.81 

1.24 

-0.19 

(.117) 

0.83 

1.21 


Up Sec vs. VET 

-1.97 *** 
(.125) 

0.14 

7.17 

-1.01 *** 
(.087) 

0.36 

2.75 

Germany 

Intercept 

-0.37 

(.085) 



0.24 

(.067) 




Low Sec vs. VET 

-0.08 

(.157) 

0.92 

1.09 

-0.19 

(.142) 

0.83 

1.21 


Up Sec vs. VET 

-1.59 *** 
(.134) 

0.20 

4.90 

-0.93*** 

(.101) 

0.39 

2.54 

Slovak 

Republic 

Intercept 

0.16 

(.150) 



0.87 ’ 
(.332) 




Low Sec vs. VET 

-1.31 *** 
(.239) 

0.27 

3.71 

-0.81 

(.441) 

0.45 

2.24 


Up Sec vs. VET 

-1.62 *** 
(.199) 

0.20 

5.03 

-0.92 * 
(.368) 

0.40 

2.50 


J : J : I I J : I 

Note. p<0.05, p<0.01, p< 0.001; Standard errors are in parentheses. 


In school-based systems, overall, we observe the same patterns as in work-based 
systems (Table 3). First, VET adults are clearly more likely to be “at-risk” or 
“weak” performers than the graduates of upper secondary education. In particular, 
VET adults are 3.1 (Ireland) to 14.7 (Belgium) times more likely to be “at-risk” 
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performers than upper secondary graduates 1 ; and the former are 1.9 (Ireland) to 5.2 
(Belgium) times more likely to be “weak” performers than the latter. We observe, 
once again, between-country variation when comparing the problem-solving skills 
of VET adults to the skills of graduates from lower secondary education (or less). 
Except for Ireland, Norway and the Netherlands, VET adults have a higher 
likelihood of being “weak” performers - ranging 1.3 (Finland) to 2.0 (Belgium). In 
the Netherlands, on the contrary, lower secondary graduates are 1.5 times more 
likely than VET adults to be “weak” performers. In Ireland and Norway, the 
differences are not statistically significant (a = 0.05). Estimating the likelihood of 
being an “at-risk” performer reveals an interesting picture as well. In fact, in 
Finland and Norway, VET adults have the same likelihood as lower secondary 
graduates to be “at-risk” performers. In Belgium and Poland, VET adults are more 
likely to be “at-risk” performers, and finally, in Ireland and the Netherlands, VET 
adults are less likely to achieve an “at-risk” problem-solving level. 


Notice that the figures of Belgium (Flanders) are potentially overestimated. In fact, 
many observations in the Belgian data are classified as “not stated or inferred” on the 
vocational education and training variable. This is due to the fact certain ISCED - 
categories, and more precisely the ISCED 3 (without distinction A - B - C) and 
ISCED 4, could not be uniquely identified as being vocationally oriented or not. As a 
consequence, these have been coded as ”not stated or inferred”. 
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Table 3: Likelihood of problem-solving skills proficiency in TREs by 
educational background in school-based countries (parameter estimates with 
standard errors and odds ratios) 


At risk performers Weak performers 


b 

Odds 

Inverse 

b 

Odds 

Inverse 


ratio 

Odds 


ratio 

Odds 



ratio 



ratio 


Belgium “ 

Intercept 

0.70 *" 
(.169) 



1.04 *** 
(.153) 




Low Sec vs. VET 

-0.43 * 
(.209) 

0.65 

1.54 

-0.68 ** 
(.221) 

0.51 

1.98 


Up Sec vs. VET 

-2.69 *** 
(.197) 

0.07 

14.67 

-1.64 *** 
(.167) 

0.19 

5.15 

Finland 

Intercept 

-0.42 "* 
(.095) 



0.28 

(.069) 




Low Sec vs. VET 

-0.27 

(.153) 

0.76 

1.31 

-0.29 * 
(T41) 

0.75 

1.34 


Up Sec vs. VET 

-1.80 *** 
(.129) 

0.16 

6.06 

-1.06 *** 
(.080) 

0.35 

2.90 

Ireland 

Intercept 

-0.25 

(.131) 



0.62 

(.114) 




Low Sec vs. VET 

1.04 *** 
(.218) 

2.82 

0.35 

0.06 

(.204) 

1.06 

0.95 


Up Sec vs. VET 

-1.13 *** 
(.138) 

0.32 

3.09 

-0.67 *** 
(.125) 

0.51 

1.94 

Netherlands 

Intercept 

-0.96 

(.109) 



0.14 

(.087) 




Low Sec vs. VET 

1.02 *** 
(.141) 

2.78 

0.36 

0.42 *** 
(.113) 

1.52 

0.66 


Up Sec vs. VET 

-1.46 *** 
(.152) 

0.23 

4.32 

-1.01 *** 
(.110) 

0.36 

2.74 

Norway 

Intercept 

-0.58 

(TOO) 



0.28 

(.073) 




Low Sec vs. VET 

0.26 

(.155) 

1.29 

0.77 

-0.06 

(.126) 

0.95 

1.06 


Up Sec vs. VET 

-1.63 *** 
(.135) 

0.20 

5.11 

-0.96 *** 
(.092) 

0.38 

2.61 

Poland 

Intercept 

0.52 

(.121) 



0.53 "* 
(.111) 




Low Sec vs. VET 

-1.32 ”* 
(.197) 

0.27 

3.76 

-0.62 ** 
(.177) 

0.54 

1.86 


Up Sec vs. VET 

-1.60 *** 
(.125) 

0.20 

4.93 

-0.78 *** 
(.128) 

0.46 

2.18 

$ X' x X x X 

Note, p < 0.05, p < 0.01, p 

< 0.001; Standard 

errors are 

in parentheses; a 

Tlie Belgian 


estimates might be biased (see footnote 1). 
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5 Discussion and Conclusions 

The PIAAC data comprise the most comprehensive source of information on 
adults’ skills to date. Therefore, it is now possible to investigate adults’ problem- 
solving skills in TREs in a novel way. The present study focuses on gaining more 
in-depth insight into the problem-solving skills in TREs of European adults with a 
VET background. At a general level, when examining the similarities and 
differences in VET adults’ problem-solving skills in TREs across 1 1 European 
countries, two main trends can be observed. First, our results show that only a 
minority of VET adults perform at a high level. Across all European countries in 
our study, adults with VET perform lower on average than adults with other 
educational backgrounds. Second, although adults with VET achieve a lower skill 
level throughout all countries, there seems to be substantial variation between 
countries with respect to the proportion of VET adults that can be identified as “at- 
risk” or “weak” performers. 

As problem-solving skills in TREs are becoming increasingly important in 
work life (Goos, 2013), our findings are in line with the critical notion that there 
seems to be a gap between what is learned in VET and what is required at 
European workplaces (Baartman and de Bruijn, 2011). Currently, European 
countries are developing their VET systems to better meet the emerging needs of 
European workplaces, and different trends can be observed. Namely, in 6 (Ireland, 
Finland, Norway, Netherland, Austria and Germany) of 1 1 countries investigated 
in this study, the share of workplace learning is increasing, while in 5 countries 
(Belgium, Poland, Czech Republic, Slovak Republic and Denmark), this share is 
decreasing (cf. European Commission, 2013; Eurydice Highlights 2012/2013; 
OECD, 2009). A clear pattern with regard to the association between educational 
background and problem-solving skills, typical for the work- or school-based 
vocational education systems, does not emerge from our analysis. Instead, our 
findings indicate the variations that can be used as a starting point to identify 
beneficial VET approaches. 

Our results suggest that when comparing adults with upper secondary 
education or higher with adults with a VET background, the same trend can be 
observed in all countries: VET adults are more likely to be at-risk or weak 
performers. However, when comparing VET adults with adults with lower 
secondary education or lower, three clusters of countries can be identified. In the 
first cluster, VET adults are more likely to be at-risk or weak performers than 
adults with lower secondary education or lower. This first cluster includes Finland, 
Czech Republic, Belgium, Poland and Slovak Republic, although for the latter this 
was only found for the likelihood of being an at-risk performer and for the former 
only for the likelihood of being a weak performer. In the second cluster, the reverse 
is true, namely VET adults perform better. This second cluster includes the 
Netherlands, Austria and Ireland, although for the latter two this was only observed 
for the at-risk performers. In the third cluster, containing Denmark, Germany and 
Norway, there is no difference between the level of TRE problem-solving skills of 
adults with VET background and lower secondary education backgrounds. These 
European variations hint towards influential differences between the countries. 
Namely, as VET is mediated by structural elements, such as the resources, norms, 
curriculum guidelines and externally mandated policies, future investigations need 
to focus on the constituent components of successful VET approaches within and 
across these three clusters of countries. 
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Workplaces and vocational schools are the two main components of VET 
(Schaap, Baartman and de Bruijn, 2012). When considering the findings of this 
study, as a whole it is important to consider that grouping national VET systems 
based on the Cedefop calculations of Eurostat data may lead to over-simplification 
in understanding the problem-solving skills in TREs of European adults with a 
VET background (as there are large between and within country variations of 
VET). Therefore, to develop VET systems that can better meet the needs of future 
workplaces, additional studies are needed to more clearly understand the 
combination of school-based and workplace learning experiences (see also Gessler, 
2009). Recently, Billett (2014) argued that the emerging challenges of VET 
research involve integrating learners’ experiences in practice settings (i.e. 
workplaces) into educational programs. In the future, in addition to large-scale 
evaluations of VET adults’ problem-solving skills in technology -rich environments, 
it will be necessary to gain additional knowledge on successful problem-solving 
processes in TRE, e.g. how learners are able to build meaningful and adaptive 
problem-solving skills in workplaces and vocational schools (Billett, 2014). 
Therefore, future research needs to focus on the in-depth analysis of problem- 
solving processes in TREs. In this respect, it could be beneficial to select the adults 
with a VET background from high-performing countries (e.g. Austria and the 
Netherlands) and the low-performing countries (e.g. Poland and Belgium) to 
understand why and where variations as well as low levels of problem-solving 
skills (cf. not classified group) exist in VET adults. 

European countries are all facing a significant challenge in identifying 
approaches to enhance problem-solving skills for adults with a VET background. 
In the future, new technologies may be one way to support these higher TRE 
problem-solving skills. Recent studies have indicated that technology plays an 
increasingly important role in enabling flexible and adaptive life-long learning 
approaches. In practice, the role of technology is often to allow new learning 
experiences, for example, to leam problem-solving through game -based 
applications (Hamalainen and De Wever, 2013), or to empower VET adults’ 
professional development (Boldrini and Cattaneo, 2012; Motta, Boldrini and 
Cattaneo, 2013). Furthermore, studies have indicated that VET technologies have 
many benefits for the development of vocational specific skills (Cuendet and 
Dillenbourg, 2013; Minnaert, Boekaerts, De Brabander and Opdenakker, 2011). 
Finally, recent research findings support the potential of designing new 
technologies and applying existing technologies in workplace settings to enhance 
problem-solving in TREs (Tynjala, Hakkinen and Hamalainen 2014). 
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Figure Al: Mean problem-solving scores in VET and NON-VET groups by countries 
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Table Al: Mean problem-solving scores by educational background for all countries 



Lower secondary or less 

VET 



Higher secondary or more 


n 

Mean 

SE 

n 

Mean 

SE 

n 

Mean 

SE 

Austria 

557 

268.84 

2.24 

2,056 

280.58 

0.90 

1,242 

298.32 

1.66 

Czech Republic 

728 

285.33 

3.12 

2,505 

273.52 

1.44 

1,442 

303.20 

2.01 

Denmark 

915 

270.10 

1.74 

1,651 

267.25 

1.23 

3,267 

298.27 

0.96 

Germany 

713 

273.64 

2.44 

1,949 

271.54 

1.31 

1,877 

299.69 

1.20 

Slovak Republic 

425 

281.31 

2.13 

751 

263.99 

1.61 

2,361 

286.13 

1.03 

Work-based 

3,338 

275.85 

1.06 

8,912 

271.38 

0.59 

10,189 

297.12 

0.64 

Belgium 

661 

259.75 

2.14 

475 

255.03 

2.25 

1,624 

297.42 

1.16 

Finland 

640 

277.03 

2.19 

1,307 

272.71 

1.30 

2,556 

302.27 

1.00 

Ireland 

551 

251.09 

2.63 

762 

269.20 

1.71 

2,779 

285.74 

1.11 

Netherlands 

1,242 

264.01 

1.08 

1,275 

279.58 

1.51 

2,030 

303.90 

1.07 

Norway 

585 

269.96 

2.01 

1,365 

274.08 

1.15 

2,391 

299.07 

0.76 

Poland 

722 

279.67 

2.94 

1,955 

255.02 

2.16 

3,314 

286.57 

1.58 

School-based 

4,401 

266.92 

0.91 

7,139 

267.60 

0.71 

14,694 

295.83 

0.47 
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Table A2: Absolute number and (weighted) percentages of adults at each level of problem-solving skills (not classified included) in work-based 
countries 


Not classified 

Below level 1 

Level 1 

Level 2 

Level 3 

Total 


n % 

n % 

n % 

n % 

n % 

n 

% 


Austria 

Lower secondary or less 

376 

45.30 

117 

13.58 

249 

24.11 

175 

15.59 

16 

1.42 

933 

100.00 


VET 

666 

24.65 

278 

10.61 

921 

34.80 

756 

26.75 

101 

3.20 

2,722 

100.00 


Higher secondary or more 

128 

10.68 

81 

5.97 

415 

29.70 

614 

43.95 

132 

9.70 

1,370 

100.00 

Czech Republic 

Lower secondary or less 

206 

35.65 

95 

10.33 

268 

23.21 

301 

25.05 

63 

5.75 

934 

100.00 


VET 

1,045 

28.27 

528 

16.04 

1,070 

30.56 

777 

21.22 

130 

3.92 

3,550 

100.00 


Higher secondary or more 

154 

8.14 

103 

5.84 

436 

27.65 

666 

43.36 

237 

15.02 

1,596 

100.00 

Denmark 

Lower secondary or less 

441 

27.64 

246 

17.29 

374 

30.62 

267 

22.19 

28 

2.26 

1,356 

100.00 


VET 

387 

16.12 

493 

21.68 

750 

37.47 

380 

22.86 

29 

1.87 

2,038 

100.00 


Higher secondary or more 

299 

6.46 

321 

6.84 

1,215 

30.80 

1,414 

44.30 

317 

11.59 

3,566 

100.00 

Germany 

Lower secondary or less 

199 

26.92 

147 

17.31 

277 

28.63 

247 

22.89 

42 

4.25 

912 

100.00 


VET 

478 

21.29 

419 

18.37 

827 

33.85 

619 

23.64 

83 

2.86 

2,427 

100.00 


Higher secondary or more 

159 

8.69 

149 

7.87 

563 

27.95 

867 

41.52 

298 

13.98 

2,036 

100.00 

Slovak Republic 

Lower secondary or less 

561 

57.97 

58 

5.61 

201 

18.78 

155 

16.38 

12 

1.27 

986 

100.00 


VET 

1,020 

56.86 

196 

11.14 

390 

22.53 

158 

8.96 

8 

0.51 

1,771 

100.00 


Higher secondary or more 

584 

18.90 

261 

8.69 

1,058 

35.32 

919 

32.43 

123 

4.66 

2,945 

100.00 

Work-based 

Lower secondary or less 

1,783 

38.70 

663 

12.82 

1,369 

25.07 

1,145 

20.42 

161 

2.99 

5,121 

100.00 


VET 

3,596 

29.44 

1,913 

15.57 

3,957 

31.84 

2,691 

20.69 

352 

2.47 

12,508 

100.00 


Higher secondary or more 

1,324 

10.57 

914 

7.04 

3,688 

30.28 

4,480 

41.11 

1,108 

10.99 

11,513 

100.00 
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Table A3: Absolute number and (weighted) percentages of adults at each level of problem-solving skills (not classified included) in school-based 
countries 


Not classified 

Below level 1 

Level 1 

Level 2 

Level 3 

Total 


n % 

n % 

n % 

n % 

n % 

n 

% 


Belgium 

Lower secondary or less 

361 

36.86 

218 

22.04 

254 

24.22 

168 

15.16 

20 

1.72 

1,022 

100.00 


VET 

158 

26.09 

162 

25.46 

233 

35.82 

77 

12.06 

4 

0.57 

633 

100.00 


Higher secondary or more 

87 

5.17 

127 

7.73 

523 

30.94 

772 

44.67 

203 

11.48 

1,711 

100.00 

Finland 

Lower secondary or less 

338 

34.56 

125 

13.13 

253 

25.96 

231 

23.15 

32 

3.19 

978 

100.00 


VET 

443 

25.50 

291 

16.40 

581 

33.08 

387 

22.22 

48 

2.80 

1,750 

100.00 


Higher secondary or more 

180 

7.10 

175 

6.42 

757 

27.11 

1,232 

45.02 

392 

14.35 

2,736 

100.00 

Ireland 

Lower secondary or less 

898 

58.98 

258 

17.50 

206 

15.59 

81 

7.24 

6 

0.69 

1,449 

100.00 


VET 

325 

31.07 

171 

14.80 

391 

35.21 

186 

17.47 

14 

1.45 

1,087 

100.00 


Higher secondary or more 

650 

18.81 

332 

9.32 

1,194 

35.15 

1,079 

31.71 

174 

5.01 

3,429 

100.00 

Netherlands 

Lower secondary or less 

339 

23.34 

334 

21.42 

576 

35.21 

304 

18.31 

28 

1.73 

1,581 

100.00 


VET 

103 

8.05 

189 

13.95 

580 

41.77 

456 

32.71 

49 

3.52 

1,378 

100.00 


Higher secondary or more 

95 

5.01 

110 

5.61 

582 

26.45 

1,054 

48.79 

284 

14.14 

2,125 

100.00 

Norway 

Lower secondary or less 

187 

27.84 

127 

17.62 

247 

30.30 

194 

22.32 

17 

1.92 

7,72 

100.00 


VET 

236 

15.77 

255 

16.41 

626 

38.62 

448 

27.01 

37 

2.19 

1,601 

100.00 


Higher secondary or more 

187 

7.59 

152 

6.28 

748 

29.00 

1,215 

46.55 

277 

10.58 

2,578 

100.00 

Poland 

Lower secondary or less 

654 

58.47 

155 

7.85 

301 

16.11 

226 

14.38 

41 

3.20 

1,376 

100.00 


VET 

1,865 

64.42 

594 

13.62 

791 

13.82 

492 

7.12 

78 

1.02 

3,820 

100.00 


Higher secondary or more 

853 

26.72 

415 

11.74 

1,204 

27.00 

1,308 

26.69 

387 

7.86 

4,167 

100.00 

School-based 

Lower secondary or less 

2,777 

40.01 

1,217 

16.59 

1,838 

24.56 

1,203 

16.76 

144 

2.08 

7,178 

100.00 


VET 

3,130 

28.48 

1,661 

16.77 

3,203 

33.06 

2,046 

19.76 

230 

1.92 

10,269 

100.00 


Higher secondary or more 

2,052 

11.73 

1,311 

7.85 

5,007 

29.28 

6,661 

40.57 

1,716 

10.57 

16,746 

100.00 
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